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WO 96/34466 PCT/US96/04819 
COMPACT GRAPHICAL INTERACTIVE BROADCAST INFORMATION SYSTEM, 

Related Applications 

The subject matter of this application is related to the subject matter of the following 
applications: application serial number AAAA, entitled, "METHOD AND APPARATUS FOR 
DETERMINING BROADCASTER INFORMATION", and application serial number BBBB, 
entitled "METHOD AND APPARATUS FOR ROUTING CONFIDENTIAL INFORMATION", 
each of the above applications filed by Brian P. Dougherty and Eric E. Del Sesto on April 25, 
1995, having the same assignee as the present invention and incorporated herein by reference in 
their entirety. 

Field of Invention 

The present invention relates to broadcast and receiving systems, and more specifically, 
to interactive broadcast and receiving systems. 

Background of Invention 

Interactive information systems allow an information provider to broadcast information 
to a user, and in some cases allow a user to send a response to a response collector. The user 
may receive the information on a wide variety of devices, such as a pager, cellular telephone, 
personal digital assistant or a television. An interactive information system on which the user 
receives the information using a television is called an interactive television system. 

An interactive television system can enhance the television viewing experience. An 
interactive television system allows an information provider to broadcast information to users for 
viewing on their television systems, and defines how the user is allowed to control the time, 
order, type of information displayed, or other aspects. An interactive television system may 
allow the user to send to a response collector responses to the information received, or new 
information. 

Some interactive television systems provide a textual user interface, displaying formatted 
textual information to the user. However unlike graphical interactive information systems, text- 
based systems do not allow the information provider to control and present a wide variety of 
graphical information and formatting that are commonly used with graphical user interfaces. A 
graphical interactive information system uses a graphical user interface to display a variety of 
graphical information and allows the user to control the operation of the system based upon the 
graphical display. Text-based systems are more difficult to use and limit the appeal of the 
interactive television system in much the same way that text-based computer operating systems 
limited the appeal of computer systems prior to the introduction of graphical user interfaces. 

One such attempt (Lappington, U.S. Pat. No. 5,343,239) inserts textual data in a binary 
format into unused lines in the Vertical Blanking Interval, or VBI, of the conv ntional television 
transmission for decoding by a set-top device and transmission to, and display on, a handheld 
remote control device. The VBI is a portion of the television picture which is broadcast, but not 
typically seen by th tel visi n viewer, and readily allows for inserti n of data, such as closed 
captioning text. Howev r, th limited data capacity of the VBI has thus far prevented the use of 
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only for the most basic equipment, nor would they likely accept a system which only operated 
with the most feature-rich equipment. 

Another problem is the requirement for interactive television systems that such a system 
work rapidly en ugh to operate in conjunction with existing broadcast television shows. For 
example, graphical interactive television system applications which operate in conjunction with 
existing television game show programs must be transmitted to display the graphical user 
interface quickly. Furthermore, there must be a mechanism to make modifications to the user 
interface quickly, to allow large amounts of information to be updated rapidly. 

Summary of Invention 

A method and apparatus allows an information provider to send a graphical interactive 
information system application to a reception component for presenting the graphical interactive 
information system to, and allowing its operation by, the user. The information provider 
provides a description of the layout and the information to be displayed, and one or more 
definitions, commands or scripts which compactly describe one or more graphical images to be 
displayed, and may describe the relationships between one or more of the graphical images, are 
encoded in a broadcast signal. The definitions, commands and scripts are compact, requiring 
relatively low bandwidth. A reception component decodes the definitions, commands or scripts 
and generates the images for display on a display device such as a television. Thus, decoding 
provides a relatively large amount of graphical information from the compact definitions, 
commands and scripts, allowing a even presently available low bandwidth broadcast media, such 
as the VBI, to be used to carry complete graphical interactive information system applications for 
display to, and operation by, a user. Even low bandwidth broadcast media can be used to carry 
complete graphical interactive information system applications for display and operation rapidly 
enough to allow a graphical interactive information system application integrated with the 
content of a conventional broadcast program or advertisement to be broadcast simultaneously 
with the program or advertisement Because special high-bandwidth media are not required, 
existing inexpensive user equipment may be inexpensively modified and used to display and 
operate graphical interactive information system applications. Because of the compact size of 
the information broadcast, the information may be stored in the reception component after 
reception on compact, inexpensive storage devices, helping to maintain the low cost of the user 
equipment 

The reception component can adapt the image based upon the capabilities of the 
reception component, the display device, or both, allowing reception and display on a vijide 
variety of user equipment Because the command decoder that adapts the image is aware of its 
own capabilities, adaptation information need not be broadcast, maintaining the small size of the 
information broadcast. Because the image is generated and adapted by the rec ption component, 
the description of the image is platform-independent freeing the information provider of the 
necessity of formatting information differently for each type of reception component. 
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ft Briff P>«CTirttiirn nf Hir""""" 1 " 5 

Flgure 1 is an iUustranon o, a conventional Revision screen di splaying a convent.0 na, 
tefcvision^ogram with a graphical interactive information system apphcaaon delayed 

" b^tgTtftve^rs and information providers according to one 

«.^ame»odofoneemb^ r ,o, = ^venaon. 

according to one embodiment of the present invention. 



WO 96/34466 PCI7US96/04819 

Figure 14A is a block diagram representing a format of a resource definition record 
according to one embodiment of the present invention. 

Figure 14B is a block diagram representing a format of a text resource according to one 
embodiment of the present invention. 
5 Figure 14C is a block diagram representing a format of a bitmap resource according to 

one embodiment of the present invention. 

Figure 14D is a block diagram representing a format of a picture resource according to 
one embodiment of the present invention. 

Figure 14E is a block diagram representing a format of a picture resource element 
10 according to one embodiment of the present invention. 

Figure 14F is a block diagram representing a format of a resource list according to one 
embodiment of the present invention. 

Figure 14G is a block diagram representing a format of a resource list element according 
to one embodiment of the present invention. 
15 Figure 15 is a block diagram representing a format of an update record according to one 

embodiment of the present invention. 

Figure 16 is a block diagram representing a format of an interactive icon definition record 
according to one embodiment of the present invention. 

Figure 17A is a block diagram representing a format of a script execute record according 
20 to one embodiment of the present invention. 

Figure 17B is a block diagram representing a format of a script resource according to one 
embodiment of the present invention. 

Figure 18A is a flowchart illustrating a method of broadcasting a broadcaster information 
table according to the present invention. 
25 Figure 18B is a flowchart illustrating a method of Receiving a broadcaster information 

table according to the present invention. 

Figure 18C is a flowchart illustrating a method of using a broadcaster information table 
according to the present invention. 

Figure 19 is a flowchart illustrating a method of drawing a form on a display according to 
30 the present invention. 

Figure 20 is a flowchart illustrating a method of drawing an object on a display according 
to the present invention. 

Figure 21 is a flowchart illustrating a method of drawing a resource on a display^ 
according to the present invention. 
35 Figure 22 is a block diagram representing a format of a response record according to one 

embodiment of the present invention. 

Figure 23 is a block schematic diagram illustrating a response network according to one 
embodiment of the present invention. 
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accordance with the present invention. The provider component 206 allows the generation and 
broadcast of the graphical interactive information system application, and the reception 
component 234 allows for the reception, decoding, control and display of the graphical 
interactiv information system application. The present invention allows the provider 
5 component 206 to define the display and control of a graphical interactive information system 
application to be displayed on the reception component 234 without requiring the high 
bandwidth normally associated with interactive information systems which display a graphical 
user interface. The provider component 206 compresses the graphical interactive information 
system applications by isolating only the information needed to allow the reception component 

1 0 234 to produce the graphical user interface and by encapsulating the remainder of the 
application. Because of this graphical application compression and encapsulation, high 
bandwidth is not required to broadcast the application. The graphical interactive information 
system application is broadcast to the reception component 234, which is able to reproduce a 
complete graphical interactive information application from the small amount of information it 

IS receives from the provider component 206 plus its own resident intelligence. 

A> Provider Component- 

The provider component 206 inserts and broadcasts graphical interactive information 
system applications onto a broadcast signal. In one embodiment, a conventional broadcast signal 
is provided by signal provider 208. In one embodiment, signal provider 208 is a program 

20 generator. In another embodiment, signal provider 208 is a video signal source from a live feed. 
In another embodiment, signal provider 208 is a video signal from a video storage device, such 
as a video tape recorder. 

The provider component 206 also contains a graphical interactive compact protocol 
generator and formatter 210. A graphical interactive compact protocol generator and formatter 

25 210 is used by an information provider to generate the interactive information system 

information to be broadcast In one embodiment, the graphical interactive compact protocol 
generator and formatter 210 is a conventional 486 personal computer system with a stored 
program for operation as described below. The graphical interactive compact protocol generator 
and formatter 210 generates the compact protocol, described below, in response to commands 

30 provided to it by an information provider* In one embodiment, the information provider types in 
the compact protocol bytes which will represent the graphical user interface as described below. 
In another embodiment, a visual interface is used to allow a form designer to design forms and 
immediately see how they will appear. The graphical interactive compact protocol generator and 
formatter 210 translates and formats the form appearing on the computer screen of the graphical 

35 interactive compact protocol generator and formatter 210 into the compact protocol described 
below. In another embodiment, the graphical interactive compact protocol g nerator and 
formatter 210 receives assignment of attribute commands such as formLborder.color = red, and 
generates the proper compact protocol commands as described below. 
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the compact protocol on any type of frequency. In one embodiment, the transmitter 214 is a 
conventional out-of-band transmitter which transmits the compact protocol on an unused portion 
of the television frequency spectrum. In another embodiment, the transmitter 214 is a 
conventional FM transmitter. Any form of broadcast, wire or cable transmitter may be used to 
5 broadcast the compact protocol. 

In one embodiment, the developer of an interactive information system application may 
be a different person or entity from the broadcaster who broadcasts the application. Referring 
now to Figures 2A and 2C, one embodiment of a provider component 266 is shown. Compact 
protocol generator and formatter 276 is similar to compact protocol generator and formatter 210. 
10 However, the compact protocol generator and formatter 276 is not a part of the provider 
component 266. Instead, another party known as the developer develops the graphical 
interactive information system applications on the compact protocol generator and formatter 276 
and provides them via diskette or modem or other communication device to the information 
provider. 

15 The information provider loads the graphical interactive information system application 

from the developer into a graphical interactive information system application server 270. The 
graphical interactive information system application server 270 sends the graphical interactive 
information system application to the compact protocol inserter 272, which is similar to compact 
protocol inserter 212, and controls the operation of the compact protocol inserter 212 to allow, 

20 for example, the information proVider to control the transport , such as VBI line used to 
broadcast the graphical interactive information system application. In another embodiment, 
graphical interactive information system application server 270 also controls the frequency of the 
application broadcast. Transmitter 274 is similar to transmitter 214. 

This arrangement allows for multiple parties to contribute to the graphical interactive 

25 information system. Referring now to Figure 2A, 2B, and 2D, one embodiment of the providers 
of graphical interactive information is shown. Graphical interactive information system 
application developers 281, 282, 283, 284, 285 develop applications using compact protocol 
generators and formatters 276 for one or more broadcasters 286, 288, 290 who broadcast 
programs, graphical interactive information system applications using provider components 266, 

30 or both, to users and cable operators 292, 294; who rebroadcast signals to users from 

broadcasters 286, 288, 290 and may provide additional applications or broadcaster information 
using provider components 206 or 266. 

B. Reception Component - Graphical Information System Appl ication Displayed 

35 In one mbodiment, the reception component 234 is contained in the user reception 

equipm nt similar to conventional user reception equipment Referring now to Figure 3, one 
embodiment of the user reception equipment 308 is shown. Conventional television receiver 310 
such as a Sony KV32V55 is coupled to a set-top decoder 312 which is coupled via cable 322 to 
antenna 316. In one embodiment, antenna 316 is replaced by a cable 324 containing a CATV 



PCT/US96/04819 

WO 96/34466 . . 

tr.nsmiss.on s.gnal. Tte -eMop available _cia.lv *-» G enera * I-™-* 
topdKodM,suchastheJem)ldDPV7217;v5Da 312 according to the 

C^rporationofHatborcPA. The interna! components of set-top decoder 312 accord g 

ri: "ir— 

l0 anod.erembc^en^r^^acon— ^^^^.^^M*^ 
THe^paoncotnpon^.^^ in one embodiment, the data 
e „rac, the compact protocol « sttch as par. number 

extractor 218 is a conventual VB1 mband data embodiment, the 

SAA^avaiiabiefromPhU^ 

memory array. ^ information from the 

I„ one embodiment, the microprocessor 222 uses the error c 

prior to storage in storage dev.ee 2*. conventiolial addressable ROM. In another 

In one embodiment, storage dev.ee 224 is a conven " md wriubte , 

embodiment storage device 224 is a conventional flash « my 
30 y«r«uunsi B conte» B whenpo W erisnolongerava 1 labl«^»»^ 

software or dau which is resident in the recepaon comport ^ of 



WO 96/34466 PCI7US96/04819 

of Newtown, PA, coupled to a c nventional video genlock processor, such as model GSP500 
available from Integrated Circuit Systems of Valley Forge, PA. The graphics display generator 

228 is coupled to bus 232 to receive the graphical user interface generated by the graphical 
interactive information system. 

5 In one embodiment, graphics display generator 228 also receives the broadcast signal 

corresponding to a broadcast program via line 227 from tuner 216 to allow simultaneous display 
of the broadcast program and the graphical interactive information system application. In 
another embodiment, graphics display generator 228 receives a broadcast program signal via line 

229 from optional additional tuner 252, and line 227 is not used. This two-tuner 216, 252 

10 approach allows a graphical interactive information application to be displayed simultaneously 
with a broadcast program without requiring the application to be broadcast on the same 
frequency as the program. 

The display generator 228 is coupled to a display 230. In one embodiment, the display 

230 is an LCD display. In another embodiment, the display 230 is a conventional television 

1 5 receiver and the remaining elements 235 of the reception component as later described herein are 
contained in a set-top decoder. 

In one embodiment, the microprocessor 222 is also coupled to a user input decoder 244 
coupled to a user input receiver 250 to allow the user to communicate with the microprocessor 
222 in order to operate the graphical interactive information system. In one embodiment, the 

20 user input decoder 244 is a conventional infrared remote control decoder. The user input 

receiver is a conventional infrared receiver 250 through which the user may use a conventional 
handheld remote control device, such as remote control 330 of Figure 3. Remote control keys 
pressed by the user translate to coded infrared signals that are received by infrared receiver 250, 
and are decoded by the user input decoder 244 and sent to the microprocessor 222 to allow the 
25 user to communicate with the interactive television system. In one embodiment, the 

microprocessor 222 responds to certain remote control keys decoded when they relate to choices 
displayed by the user component 234, but not to other remote control keys, to allow the operation 
of functions unrelated to the graphical interactive information system application simultaneously 
with the operation of the graphical interactive information system application using the same 
30 user input device. 

In another embodiment, the user input receiver 250 is a conventional personal digital 
assistant keypad device and the user input decoder 244 is a conventional keypad decoder. In 
another embodiment, the user input receiver 250 is a conventional cellular telephone keypad 
device and the user input decoder 244 is the keypad decoder. In another embodiment, the user 
35 input receiver 250 is a conventional pager switching device and the user input decoder 244 is a 
conventional switching device decoder. 

C. Recention Cnmpnn^t - External TV vice Cnntml 

In on mbodiment, microprocessor 222 is coupled to a c nventional infrared command 
encoder 256 which accepts an infrared command input and encodes a signal for a conventional 
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in. Compact Protocol. 

The compact protocol is used to broadcast a compact set of information and commands 
from the information provider to the user in an efficient manner, allowing the use of low 
bandwidth transports such as the VBI. 
5 Referring now to Figure 4, one embodiment of a method of sending and operating a 

graphical interactive information system using the compact protocol is shown. In one 
embodiment, an application header record is encoded and broadcast to initiate the process and 
describe the information which follows 410 412. The application header record and the 
information will define a graphical interactive information system application. One or more 

10 desired graphical descriptions such as object or resource definition records and optional scripts 
or commands, each described below, are encoded and broadcast in any order 416, 418. In one 
embodiment, the application header record is received and decoded 414 prior to the encoding of 
definitions, scripts and commands 416, although other embodiments encode, broadcast, receive 
store and decode the application header record, definitions, scripts and commands in one unit. In 

15 one embodiment, no particular order of the steps described above is required as long as the 
application header definition is broadcast before the broadcast of any definition, script or 
command in the application. The information broadcast is received and decoded and used by the 
reception component to display the graphical information and to allow the user to interact with 
the information broadcast and perform the functions described herein 420, 422. Some or all of 

20 the information broadcast may be stored at any time 420. 

In one embodiment, a graphical interactive information system application is broadcast 
again and again, allowing a user to tune to a program at any time yet receive the entire graphical 
interactive information system application. 

Any desired updates as described below may be encoded and sent 424 and received and 

25 decoded 426. If there are additional definitions or updates of resources or objects, they may be 
sent until the application is complete 428, 430. In one embodiment, a termination command 
described below is broadcast to stop the operation of the application 430. 

As described below, a new application may be sent while an original application is in 
operation or transmission, for example, to allow a new advertisement application to interrupt an 

30 original program application, which resumes operation upon termination of the advertisement 
application. In one embodiment, the new application is also broadcast and operated using the 
method described above and shown in Figure 4. A suspend application command is sent by the 
new or original application in order to suspend the operation of the existing appiication^and a 
resume application command may be sent by either application to terminate the new application 

35 and resume the operation of the original application. In another embodiment, the new 
application must send a termination command in order to terminate itself, as a resume 
application command would only suspend the new application and resume the original 
application. 
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■ hiahLdwidftdUplay components which would otherw.se be required, 

HlaUandwidthuansponsnchas^^is^,-- 

Z £Z« of complex graphics. Second, ft. system is device-uidependent. Th 

reception components. 

A ^ n' ^""^ 1 1 "^ ,,,, ^ witn 3, appiicaUon header record to identify 

equal to 1 '^^^^^^^^i^ncM. Byte 512 
Byte 512 may have a value equal to 2, signifying a virtual mie 

20 may have other vah.es, ^^Z^UM contain me version and revision 
^^^nSasdescHhedhelow. --^^ 

25 protocols which are generated by d '^'^° , , which spec .fies a version 

one embodiment, the recepaon concern 234 d^rds J> 

func^^^ 

«, 7B, 8 », tO, 11, li 13. 14A, 14B, 14C 14D, 14E, 15, 1*. 17A. 17B and 22. 
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B. Graphical Object Definitions. 

The compact protocol allows the broadcast of graphical interactive information by the use 
of a set of graphical object definitions. Graphical object definitions describe characteristics of 
graphical objects, such as size of the bject, color of the object, location on the display, and other 
5 characteristics of the graphical object. Graphical objects include the form object, buttons on the 
form, bitmaps, pictures, lists, as well as non-graphical objects such as timers. In one 
embodiment, a text object contains descriptive information such as font and color about a text 
string, as well as the location of the text string, but does not contain the text string itself. Text 
strings are resources, and are separate from a text object which describes them. 
10 1. Form Definition Record. 

Each application may contain one or more forms. A form is a collection of objects which 
are defined as a single unit by the information provider using a form definition record. Objects 
in a form which are capable of being displayed are displayed together. 

Referring now to Figure 6, one embodiment of a form definition record 608 is shown. 
15 Byte 610 has a value of 2 to identify the record as the start of a form definition. Word 611 is the 
size, in bytes, of the form definition record. Byte 612 is an identifier assigned by the information 
provider to identify the form defined by the form definition record 608. In one embodiment, a 
second form having the same form number as one already defined in an application is ignored. 
Block 614 contains one or more object definitions for the form as described below. 
20 Referring now to Figures 2B and 6, in one embodiment, after microprocessor 222 

receives a form definition record 608, the microprocessor 222 under control of a program stored 
in storage device 224 allocates an area of the storage device 226 for the form, the objects on the 
form, resources required by the form and application control information to allow the user to 
interact with the form. Microprocessor 222 generates and stores several tables in storage device 
25 226 as described below. 

3. Object Definitions. 

Several standard objects may be defined using compact object definitions, which allow 
the user to specify the look of graphical objects by transmitting an object identifier as the first 
byte of the object, and only a few parameters. 
30 a. Form Objects. 

One type of object is a form object. A form object defines a rectangular region of the 
screen and the appearance of the region. The information provider defines form objects using a 
form object definition record. V* 

Referring now to Figure 7A, one embodiment of a form object 700 having a border 706 
35 and an interior 702 is shown displayed on a screen 703 of a conventional television set 704. 

The form object may be transparent, in which case the other objects in the form appear to 
float over the display. If the display is a television screen, and the application is not a graphical 
interactive virtual channel, a transparent f rm object can cause the other objects in the form to 
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appear to float over the broadcast picture. Omerwise. the form object covers all or a part of the 
bro^piWureandtheobjectsmaycoveralUpart.ornoneoftheform. 

Referring now to Figures 7Aand7B, one embodiment of » form object definmon record 
708 is shown. Byte710 iden.if.es me object asaform by having a value of 00000. in the .east 
5 significant six bits. Bytes 712, 714,71*, 718 contain the position of the leftside,**, nghts.de 
^bottom o,«he form 700. respectively, relative to the center 701 of the screen 7.3usmg a 
coarse coordinate system. A coarse coordinate system is a reputation of a urn. of w dm and 
heigh. In one embodiment me uni. of width and height is selected to al.ow representation of me 
en're widm or height ofthe display in a single byte of 256 unique numbers. 
,0 the display is a Norm American tension signal television screen accordmg to 

ling a width of 160 color dock widths, each color clock widm being the w.dth covered by the 
eleoti^r^ in 280 nanoseconds, and a hei^ *«* 
mtodiment coarse coordinate uni* equal one color Cock in width and two scan hues . h«gh, 
In one embodiment me center 701 of me screen 703 is represented as coarse coord.na.es 128, 

" B yte719cont»nsadescriptioncod.for*es^ 

emolument valid description codes are 0 for no border. 1 for a mm line border, 2 for a *.ck 
3 for a gomic style border, and 4 for a border having a "wavy" appearance though 

oL^l/comduLutercodesorsryles. Byte720conteinsaco,or^for*e».or 
20 tie border 706. Byte 721 contains a color code for me color of me intenor 702 of m. form 

70 °' Byte 722 and word 724 are used to locate the script described below, for .he form. Byte 
722 is an index into a script handle table for me location of me firs, byte of a scrip, resource 
^rTn te scrip, .o exLte. A scrip, hand,* «b,e is . table of pointers ,0 the scnp. re^rces 
25 ^application A scrip, resource is a block of memory which may contam numerous 
Lip*- 

Jains me offset from the first memory location of me scrip, resource «o me nut— 

If the most significant bit of byte 710 is set. block 730 contains optional Mn. information 
30 regarding! appearance of the form, such as textured appearance or transit™ .effects ^ch as 

^interactive system cannot accommodate .he appearance o, eff«ts — »» *» 
Mn^e Interactive system may ignore the information or display i, as closeiy as «*- 
most significant bit of byte 710 is cleared, block 730 contains no bytes and » no. used. 

to^obSfmebunonobject. Referring now „ Figure 1. buttons 1,8. 124 are 
selected by the user in order to interact with me graphical interactive information system. A 
button is defined by the information provider using a button object definmon record. 
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Referring now to Figure 8, one embodiment of a button object definition record 808 is 
shown. Byte 810 has a valu of 2 to identify the definition as a button object. Bytes 811, 812, 
813, 814 identify the positions of the left edge, top edge, right edge, and bottom edge of the 
button as a distance from the upper left hand corner of the form in coarse coordinate units. 

5 Word 816 contains a resource number corresponding to a text, bitmap or picture resource 

to use for the button. Numbers on the button are inserted automatically on this image based 
upon the location of the button on the form. Optional byte 817 contains text color information, 
and optional word 818 contains bits corresponding to the font, size and style of the text if the 
resource is a text resource, indicated by setting the second most significant bit in Byte 817. 

10 Resources are described below. In one embodiment, the text size measurement is in 1/5 00th of a 
display screen height. 

Byte 820 contains an index into the script handle table to the pointer for the script 
resource containing the script to execute when the user selects the button. Word 822 contains an 
offset from the start of the script resource to the script to be executed when the user selects the 

IS button. 

The most significant bit of byte 810 is set if hint information exists in block 828. A hint 
is a description of how an object can appear on certain systems capable of displaying such an 
appearance. Where the reception component is not capable of such a display, the hint may be 
ignored, or the reception component may provide an appearance matching the desired 
20 appearance as closely as possible. Numbers are assigned to buttons and displayed by the 

reception component, but these assignments may be overridden using hints. Other hints for one 
embodiment are listed in A ppendix A . Optional block 828 contains one or more bytes of the hint 
data if the most significant bit of byte 810 is set, and block 828 contains no bytes otherwise. 

g, Text Objects- 

25 Text object descriptions are provided by the information provider to describe the location 

and appearance of text, but do not contain any of the actual text itself. The text itself is a 
resource, described below. 

Referring now to Figure 9, one embodiment of a text object definition record 908 is 
shown. Byte 910 contains an object type identifier having a value of 3 to indicate the object is a 

30 text object Bytes 912, 914, 916, 918 describe the left edge, top edge, right edge and bottom 
edge, respectively, in coarse coordinate units from the upper left comer of the form object, of a 
box into which the text resource may be placed by the reception component. Byte 920 contains a 
code for the color of the text Byte 922 contains text alignment information. Word 92^jcontains 
the resource handle of the text string which the reception component is to display in the box. 

35 Word 926 defines th font, size and style to use to display the resource. The font makes 

up the first four bits, the size makes up the next six bits and the style makes up the remaining six 
bits of word 926. 

Block 932 contains optional hint flags, size and data similar to the hints described above 
and shown in Figure 8. 



PCT/US96/04819 

WO 96/34466 

,o dispiay abinnap ™' d ""*" d be,ow ' " T fMm ' An 

information provider defines a bitmap object using a bitmap object definition record. 

RefeLg now to Figure 10. one embodiment of a bitmap object definmon record 1008 . 

oM^n^U-Sectisabitn^objec.. Bytes 1012, !014, 101*. 1018 define the ten ed^ 

comer of the form object of a box into which ft. bitmap may be piaced. 

Word 1022 contains a handle to the resource contaimng the bitmap. Block 1032 provioe 
10 hints as described above and shown in Figure 8. 

Slides me user with a lis. of option, and allows ft, a 

moreo^™ . ^<^^^'"^^'^tc^^ 

toferringnowtoFigurell.oneembommentof.listobject^fmmonrecori 

Referring now rarg ffc „, 1110( ^tainanobiecttyi>eidenUfierhavingavalue 
„ shown. The leas, significant six bits of byte » * me , eft ^ top 

of 5 to indicate the object is a list object Bytes 1111, 111*""." 

comer of me form object of a box into which me lis. may belayed. 

If the second most significant bit of byte 1110 is set then word 1116 holds font .size .no 

llisewmdllWandbytellMareunuseo. Byte 1118 holds the number of entries in the 
^dbytetm allows .default selection to be specified nsingmeo^.fthee.Utesin 
T !7m berinning with entry 0. In one embodiment the default selection » mmalty 

25 !^t^dby*esc^^ 

ml ro^onuuntag me resource handle, described below, of the e*h entry . the list. 

* In onVeiubodiment the reception component displays the resources along with, number .« 
JlTe^u^ - accomodate selection by the user, unless overridden b, hmfc. * 
30 mbodiment user responses, such as specific remote com™, keys, are assigned t. move 
a cursor up or down the items in the list. 

SI the graphical interactive informal system appiication ^se 

indicating if .he timer operates one time, or restans again after each period has elapsed. Word 
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1212 contains a value equal to the period of the timer in l/60ths of a second. Byte 1214 contains 
the script handle of the script resource containing the script to Execute at the end of the period 
indicated as described above. Word 1216 contains an offset from the start of the script resource 
specified as described above to the script to execute when the period has elapsed from the time 
5 the object is received or the last period ended. 

g, Picture Qbjggts- 

A picture object allows an information provider to define a picture using a picture 
resource, which is a list of several bitmaps, text resources and drawing primitive functions, 
which can allow the picture resource definition to be more compact than an equivalent single 
10 bitmap resource. An information provider defines a picture object using a picture object 
definition record. 

Referring now to Figure 13, one embodiment of a picture object definition record 1308 is 
shown. Byte 1310 contains an object type identifier having a value of 7 to indicate the object is a 
picture object. Bytes 1312, 1314, 1316, 1318 define the left edge, top edge, right edge and 
1 5 bottom edge, respectively, in coarse coordinate units from the upper left corner of the form 
object, of a box into which the picture resource may be placed. 

- Word 1322 contains the handle of a picture resource, described below, to display in the 
box. Block 1328 provide hints as described above and shown in Figure 8. 

C, Resowrcc Definitions- 

20 Unlike object definitions which define the appearance of an object, resources represent 

data which can be displayed. The compact protocol also allows the information provider to 
define certain resources, such a bitmaps, to provide the pictures or icons 120, 122 shown in 
Figure 1. Text is also provided through the use of resources. Some resources are predefined, 
and others may be defined by the information provider. An information provider defines 

25 resources using resources definition records. 

Referring now to Figure 14A, one embodiment of a resource definition record 1408 is 
shown. Byte 1410 identifies the record as a resource definition record by having a value equal to 
2. Word 1411 contains a value equal to the number of bytes in the resource definition record. 
Word 1412 is the resource handle of the resource. 

30 In one embodiment, four types of resources may be defined in block 1414, a text 

resource, a bitmap resource, a picture resource and a bitmap resource list. The stored program in 
the storage device of the reception component will interpret the resource and format it according 
to the capabilities of the reception component so that it may be rendered as closely as possible to 
the definition. If necessary, the stored program may discard a resourc definition data that it 

35 cannot use, for example, because the resource has a higher resolution than the reception 
component is capable of rendering as described below. 
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text, and block 1432 contains a null terminated text string, such as ASCTJZ. 

? TlinntWl mi-uer EGA/VGA 

A bitmap resource is used to hold bitmaps. Bitmaps are describe* . Khewer, UMW 
A bitmap re Referring now to Figure 14C, 

Pnvmm*. R*rence Gmie (2nd. ^ value „^ 2 

.ne embodiment of a bitmap ™ 1438-s ^ ^ >he fc 

than the coarse coo 1442,1443, 1444 define four colors for use as described 

^^bl^^tltrnavbeused. bitmaps using a b,* 

conventional run-length encoding, 
bitn^andprimidvedr^g^^ 

bS to Uie picture resource deftoiuon record. Block 14*4 contains zero or more picture 
resourceelementsdescribedbelow. .„,„, aoicmre resource element is shown. 

0 The.e^sigmf.can,stxb«,mb^.^ 

vertical line. The type coaes are u»u» „.„:,. a i i ine drawing function = 3, 

recungl. drawing function = 4. fined rectangle £ ^ g 
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screen of the lower right corner of the element, except for the horizontal line drawing function, 
which does not contain byte 1478, the vertical line drawing function, which does not contain byte 
1476, and the point drawing function and bitmaps which do not contain bytes 1476 or 1478 
because in each case, the omitted byte or bytes are unnecessary. Byte 1480 contains the color 
S code for the element, unless the element type is bitmap. Word 1482 contains a resource handle if 
the type is text or bitmap, otherwise, word 1482 is unused. Block 1484 contains additional 
information if the type is text, similar to word 926 of Figure 9. 
4i Resovireg Lists 

Resource lists contain one or more bitmap resources. Referring now to Figure 14F, one 
10 embodiment of a resource list 1488 is shown. Byte 1490 contains a unique value to identify the 
resource as type resource list. Block 1492 contains one or more resource list elements. 
Referring now to Figure 14G, one embodiment of a resource list element 1498 is shown. Word 
1497 contains an offset to the byte following the resource list element, or zero if resource list 
element 1498 is the last element in the list. Block 1499 contains a bitmap resource described 
1 5 above and shown in Figure 14C. 

D. Indexing Definitions. 

Referring now to Figure 2B, in one embodiment, microprocessor 222 performs several 
memory management functions. Microprocessor 222 maintains in storage device 226 a pointer 
to each form in an application using a form handle table. The form handle table contains a 

20 pointer to the first byte of each form object in the application. The objects in each form are 
stored as a linked list, with the form object pointing to the first object in the linked list. An 
object is located by using the form handle table to locate the form, and then traversing the linked 
list until the desired object is located. In one embodiment, objects may be referenced by type and 
position in the list. For example, button 3 is the third button found while traversing the list. In 

25 another embodiment, all objects are sequentially numbered in the list, and objects are referred to 
by this object number. 

The location of each resource is stored using a resource handle table in which each entry 
in the table contains a pointer to the resource. The resource is located by using a resource handle 
index to locate the pointer in the resource handle table, and using the pointer to locate the 

30 resource. 

Because several applications may be resident in the storage device 226 at one time, more 
than one set of the tables and lists described above may be maintained by microprocessor 222, 
allowing a program application to stay resident while an advertisement application is operating, 
so that th program application need n t be reloaded after the end of the advertisement when the 
35 program resumes. The program application or advertisement application may be suspended or 
terminated by an advertisement application. In one embodiment, more than one advertisement 
application may be resident in storage device 226 to allow a user to send a response to one 
advertisement application after the advertisement terminates, yet still receive the application for 
the following advertisement In one embodiment, only the form or forms of the application 
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reiated ,o the response will remain in storage device 226 after microprocessor 222 receives a 

second advertisement application. 

Lon.em*Kumn,aprogramap^^^ 
„»„ an advertisement application due to the longer running time of the program apphcaaon to 
5 oTelt nX progl. application ma, occupy 75% of the available memory as desenbed 
ZoTZX 'or one or more advertisement applications. A virtual interacts channel 

m^level of proton without a significant increase in complexity of™ 

graphs interactive information system applied uses as the memory preserve* and 
terminating the application if the application's memory allocation is exceeded. 

definitions in an application. Bte 
Rrferrine now to Figure 15, one embodiment of an update record 1508 is shown. »yie 

ess rr». 

l^^oco, also allows the information provider to send instructions to the 
.eception component . control the operation of the interne information system. 
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A form may be displayed using a two byte command. The first byte has a value equal to 
5 to indicate the command is a form display command, and the second byte contains the form 
number. The form display command allows the information provider to display a form without 
any input from the user. 

A program application may be suspended or resumed by an advertisement application or 
virtual channel using the single byte commands suspend and resume, having a value of 6 and 7, 
respectively. An application may be permanently terminated by sending a single byte command 
having a value equal to 8. 

G. Interactive Icon Definition. 

In one embodiment, an interactive icon is shown on the display to indicate an interactive 
application has been received by the reception component. The user can then press one or m re 
keys on the remote control to display the first form of the application. The information provider 
may control the icon displayed by sending an interactive icon definition record. 

Referring now to Figure 16, one embodiment of an interactive icon definition record 
1608 is shown. Byte 1610 contains a value of 9 to identify the record is an interactive icon 
definition record. Bytes 1612, 1614, 1616, 1618 define the distance in coarse coordinate units 
from the center of the screen of the left edge, top edge, right edge and bottom edge, respectively, 
of a box in which the interactive icon will be displayed. The upper left edge of the icon is placed 
at the upper left edge of the box defined. Word 1620 is the resource handle of the resource to be 
displayed as the icon. 

H. Scripts. 

Scripts are a sequence of one or more scripting commands provided by an information 
provider. A script may be executed when received, or may be executed in response to an acti n. 

In one embodiment, the compact protocol allows an information provider to send a script 
which is executed upon receipt and then discarded. An information provider defines the script to 
execute using a script execute record. Referring now to Figure 17A, one embodiment of a script 
execute record 1708 is shown. Byte 1710 having a unique value to identify the record as a script 
execute record. Word 1712 contains the number of bytes in the script execute record. Block 
1714 contains the script resource, containing one or more codes as described in A ppendix B . 

The compact protocol also allows the information provider to provide scripts defining the 
operation of the system in response to user selections or other events. Four objects may have 
scripts associated with them: forms, lists, buttons, and timers. The form object script is executed 
when the form is displayed. A list object script is executed when the user indicates a selection. 
A button object script is xecuted when the user selects th button. A timer object script is 
executed at the end of the timer period. 

A script can display or hide a form or an object on the form, modify an object's 
characteristics, such as color or size, or modify which resource an object will use. A script can 
also declare variables unique to the script and change the values of those variables. A script can 
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u « a nH" "if then", etc. In one embodiment, the script 

standard logic functions, such as or, and, it..tnen ,eic 
use standard log & convemional basic inter preter. 

described in AW*** of a rcsponse byte or byte 

reputing to command. o« word of cos. -"^'J^Id Wow. Tb. cos. 
^ow a. infon^on provider » indict . «-* « „ check me price of 

order ,o venfy M * does am «-* ^ ^ ffi dcscribed Mow. 

co—sinUlarU.^BASICpr^g.^ 0 ^ K M e or mc« numeric 
M ^£rrr^S^-- Oneer^uses,^ 

to 64K bytes long which stores one or more scripts. A senpt han 
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resources by storing the memory location of the first byte of each script resource. The precise 
location of the start of each script is provided to the system as an index into the script handle 
table, and an offset from the location pointed to by the script handle tabl entry corresponding to 
the index. 

5 Scripts are executed using a command interpreter which performs the functions indicated 

until it reaches an end of script identifier. In one embodiment, the script instructions are 
interpreted directly from the codes which make up the script resource, and in another 
embodiment, script instructions are first converted into C++ code prior to interpreting them. 
IV, Broadcaster Information. 
10 Referring now to Figures 2A, 2B, 2C and 18C, in one embodiment, an information 

provider such as a cable television operator uses the provider component 266 to create, insert and 
broadcast broadcaster information as a graphical interactive information system application for 
reception and decoding by a reception component 234. 

In one embodiment, the information provider provides broadcaster information to allow a 
1 5 reception component 234 to build a broadcaster information table. A broadcaster information 
table organizes some or all broadcaster information to allow the reception component 234 to 
locate the tuned frequency or other identifier of a broadcaster or an application. 

Broadcaster information may reach the information provider in a variety of ways. 
Broadcasters or other information providers may send broadcaster information relating to their 
20 broadcasts to the information provider. For example, the transport a broadcaster uses to 
broadcast graphical interactive information system applications, such as VBI line 14, and the 
broadcaster's network identifier, such as CNN, may be provided by the broadcaster to the 
information provider who will provide broadcaster information. The broadcaster can also 
identify whether it provides programs, interactivity or both, and any interactive information 
25 system protocols it uses. Thus, a broadcaster may be an information provider for interactive 
information system applications it broadcasts, and provide content to another information 
provider, the cable operator, who broadcasts the broadcaster information via its own provider 
component 206. 

The information provider who will broadcast the broadcaster information can assemble 
30 information received by others, provide its own broadcaster information or both. For example, 
the cable operator can provide the channel guide containing a frequency identifier such as the 
frequency or channel number and call letters for each of the broadcasters on the cable system in 
addition to information it receives from broadcasters or other parties. V* 

In one embodiment, an information provider broadcasts a broadcaster information table 
35 by broadcasting broadcaster information such as broadcast channels available to the user, the 
broadcast frequ ncy corresponding to the channel, call letters corresponding to a broadcaster on 
the channel, network identifiers for the broadcasters, or interactive information protocol or 
location inf rmation for a broadcast or an application 1810, whether a broadcaster broadcasts 
programs, graphical interactive information syst m applications or both 1811, a broadcast 
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program tuned frequency location identifier 1812, and interactive information system application 
tuned frequency identifiers 1814 for the broadcaster or for particular applications broadcast by 

the broadcaster or others. 

Referring now to Figures 2B and 18B, in one embodiment, the reception component 
receives the broadcaster identifiers 1820, whether a broadcaster broadcasts programs, graphical 
interactive information system applications or both 1821,broadcas, program tuned frequency 
location identifiers 1822, and interactive information system application tuned frequency 
identifiers 1824 and stores this information in storage device 226. 

Referring now to Figures 2B and 18C. a desired frequency is located given any of the 
, entries in the broadcaster information able by locating a desired entry 1830, identifying the 
tuned frequency of the desired broadcaster or interactive information ^«-W»^"» 32 
and tuning the desired frequency 1834. for example, if channel 4 contains KRON, the NBC 
affiliate, broadcasting graphical interactive information system apphcations on l.ne 14 of the VBI 
on channel 9. this information is stored in the reception component 234 as described above^An 
5 interactive application corresponding to ctannel 7 may instruc4 the reception component 234 to 
switch the tuned frequency of the program channel to the NBC affilia* using a comnund which 
only identifies NBC as the target channel. Tbe interactive information system reception 
component 234 ma, men identify the proper Cuumel corresponding to the NBC 
chatLubylocatingthe desired broad^^ 
.0 tuned frequency or channel of the desired broadcaster from the entry containing the broadcaster 
tafc^on 1832 and switch the tuned frequew^ 

channel or frequency of the desired broadcaster or application 1834. When tuner 216 ,s changed 
«, channel 4, either b, the user or an interactive information system application, reception 
component 234 under control of microprocessor 222usingme bn.adc.ste, inforrru^on uble 
25 switchmne^toctonelSanddeco^^^^ 

system applications corresponding to the broadcast program on channel 4. In one embodiment, 
the previous channel or application information is stored in storage device 226 to allow the 
in Jactive information system to return the use, to the original channe! 7, for «-*>*£~ 
exits the new application or the interactive information system application on line 14 of the VBI 
30 of channel 9 is not received. 

Referring now to Figure 2B, as described above, in one embodiment, information related 
to interactive information system applications may also be broadcast, received and stored as a 
1 of the broadcaster information table. If graphical interactive information system a^phcauon 
number 5407138 will be broadcast by KRON, this information may also be apart of the 
35 br adcaster information table, allowing the interactive information system t locate this 
application upon command, for example, from another interactive information system 

Sation^ 

of tuner 217 without changing the tuned frequency of tuner 252. 
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In one embodiment, the developer uses the compact protocol generator and formatter 276 
to create interactive information system applications which refer to other applications by using 
application identifiers, and the graphical interactive information system application server 270 
allows the broadcaster to further modify the application by adding available broadcaster 
5 information regarding the other applications to allow the reception component to locate the other 
applications. 

V, Image Generation- 

An application may display the first form when the reception component receives the 
application header record, the first form definition, including objects for that form, and resources 

10 related to the objects on the form. Additional forms may be broadcast while the first form is 
being displayed. In one embodiment, if the user response causes the application to display a 
form for which the form definition or one of the required object or resource definitions has not 
been received by the reception component, the application will wait for 10 seconds for the 
receipt of the missing information, and if not received, abort the application and display an error 

15 message. 

Referring now to Figure 2B, display generator 228 contains an addressable video RAM. 
When* VGA color code is written into the video RAM of the display generator 228, a pixel 
appears on the display 230 corresponding to the address of the code written. Thus by sending 
various bitmaps, the form is displayed. The use of bitmaps and video display adapters is 

20 described in Kliewer, EGA/VGA Programmer's Reference Guide (2nd. ed., McGraw Hill 1990). 

In one embodiment, all color codes are broadcast as VGA color codes. VGA color codes 
are described in Kliewer, EGA/VGA Programmer's Reference Guide (2nd. ed., McGraw Hill 
1990). In another embodiment, a different set of color codes are used. In one embodiment, the 
color code is converted at display time to a color suitable for the reception component by 

25 mapping it to another color. For example, some of the VGA color codes are too bright for use on 
certain displays, such as color televisions, and thus, a 256 entry lookup table is used to convert 
the VGA code into the acceptable code. In one embodiment, the result of the lookup reduces the 
saturation of the RGB values by 25%. In another embodiment, codes indicating saturation of the 
RGB values in the top 25% are held to 75% of the maximum. The 25% value was selected to 

30 accommodate the color restrictions imposed by the NTSC video signal standards, and 

conventional color television circuitry. The lookup table approach can map to any number of 
colors. In one embodiment, 100 colors are used, another embodiment uses sixteen colors, and 
another embodiment uses only two colors. V~ 
The reception component stores bitmap resources defined using bitmap resource 

35 definitions described abov in storage device 226. In one embodiment, all text characters in 
various fonts, styles and type sizes are stored as predefined bitmaps in storage device 224 to 
allow for rapid display of these characters. In another embodiment, these text characters are 
stored as outline fonts, and bitmaps are generated from the outline fonts. Other predefined 
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resources are also stored to allow commonly-used objects such as bitmaps of credit cards. 
Predefined resources are listed in Appendix C 

Referring now to Figure 19, a method of generating the images from the form object and 
other object definitions is shown. When a display form command is received, either via the 
5 broadcast or via a script, the video RAM is erased 1910 and the objects and resources are drawn. 
In one embodiment, the form object is drawn first 1912, followed by the objects and resources 
appearing on the form 1914, 1916 until all objects and resources are drawn 1920. This allows 
the objects and resources to appear overlaid onto the form. Objects and resources are located 
using the handle tables described above. 
10 Referring now to Figure 20, one embodiment of a method of drawing an object is shown. 

An object is drawn by reading the corresponding object definition 2010, generating a bitmap 
corresponding to the object definition read 2012 and sending it to the graphics display generator 
2014 In one embodiment, the entire bitmap is generated 2012 prior to sending 2014. In another 
embodiment, portions of the bitmap are generated 2012 and sent 2014 until the entire bitmap is 
15 complete 2016, 2018. Generating the bitmap is accomplished by rendering the color of each 
pixel within the boundary of the object as specified by the object definition. 

Referring now to Figure 21, one embodiment of a method of drawing a resource is 
shown Each bit in the bitmap of a resource is read 2108 and translated 2110 into the format of 
the graphics display generator if required. For example,each bit in a four-color bitmap resou^e 
20 may JtianslatedintoamodifiedVGAcolorcodeasdescribedabove. The translated bit is sent 
2112 to the graphics display generator using the position information in the resource > defimuon 
for display by the display device. In one embodiment, all of the bits are assembled 2110 into a 
bitmap prior to sending 2112, and in another embodiment, each bit is sent after translation 2112. 
The method continues until the resource is drawn 2114, 2116. 
25 Y], Rftspnnsfi feneration 

When an application allows a response and the user has a reception component capable 
of transmitting the response, the user may provide response information to a response collector. 
Referring now to Figure 2B, in one embodiment, each reception component 234 is assigned a 
unique code at the time of manufacture and this code is stored in the storage device > 22* 
30 Individual users of me recept^^ 

user responds to an object which generates a response, the reception component generates a 
response record to allow the response collector to route the response as described below. 

RefemngnowtoFigure22.oneembo^^ ^ 
word 2210 contains the unique code of the reception component, and long word 2212 contains 
35 theuniqueapplicationcodesentintheapplicationheader. Byte 2214 contains a user identifier, 
to allow the user to distinguish himself from others who may use the reception component, hi 
one embodiment, anonymous responses do not contain the reception component or user identifier 
2210 2214 to allow for the user to maintain anonymity. Block 2216 contains the defined 
response information byte or bytes described above to designate quantity or product information 
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according to the user's response. In one embodiment, a passcode is maintained in the reception 
component, and the user is required to enter it to generate the response to the response collector. 

Referring now to Figure 23, a response network containing three reception components, 
one response collector, and two vendors is shown. User reception components 2310, 2312, 2314 
5 are coupled to response collector forwarding equipment 2316 via communication lines 2311. 
Communication lines 2311 may be permanently connected or temporarily arranged as needed. In 
one embodiment, communications lines 2311 are arranged through the public switched telephone 
network when a reception component 2310, 2312, 2314 dials a telephone number of the response 
collector. In another embodiment, communications lines 2311 are cable television cables. Any 

10 form of communication, even using an intermediary such as telephone equipment owned by the 
telephone company, will allow operation of the present invention. In one embodiment, response 
collector forwarding equipment 2316 is an industry standard UNIX-based computer system 
coupled to at least one modem to receive and/of transmit data. 

The response collector forwarding equipment 2316 is coupled to vendor ordering 

15 equipment 2318, 2320 using communication lines 2319 similar to communication lines 2311 to 
allow the response collector equipment 2316 to react to the receipt of responses sent by a 
reception component 2310, 2312, 2314 by sending user information and other information to 
vendor ordering equipment 2318, 2320 as described below. 

Referring now to Figure 24 a method of collecting and sending confidential user 

20 information such as credit card number to a vendor is shown. The response collector obtains 
user information such as reception component number, user number, name and address, and 
confidential information such as credit card number 2408, 2410. In one embodiment, this is 
accomplished by mail. In another embodiment, this step is accomplished by telephone. In one 
embodiment, the information is verified, for example by checking the credit card billing address 

25 with the address provided by the user 2411. 

The response collector obtains routing information and an application identifier from the 
information provider 2412, and associates the routing information with the application identifier. 

The application identifier broadcast to the user as described above and a user reception 
component and user identifiers are sent to the response collector 2414. Because no confidential 

30 information is sent, unsecure communication lines may be used to send the information. The 
response collector then forwards the user information including user confidential information 
and response information to the vendor associated with the application identifier received 2416. 
This step may be accomplished using a secure facility, such as mail or telephone line. The 
vendor may then provide a service or products to the users address with less likelihood of fraud. 
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Appendix B 
Script Codes 



Statements 



10 



15 



20 



25 



IF 

WHILE 

{function call statement} 
RETURN 

{integer assignment} 
{string assignment} 
{boolean assignment} 



0x12 



Expressions 



0x10 
0x11 

0x13 
0x14 
0x15 
0x16 



Toten Value 



{integer variable} 
{string variable} 
{boolean variable} 
{integer constant} 
{string constant} 
{boolean constant} 



{integer equal} 
{string equal} 
{boolean equal} 
{string compare} 
{is substring} 
AND 



OR 
30 NOT 



35 / 



40 



45 



{mod divide} 

{string concatenation} 
{string extraction} 

{integer object access} 
{string object access} 
{boolean object access} 

Delimiters 

{end of string} 

{end of statement list} 



0x20 
0x21 
0x22 
0x30 
0x31 
0x32 

0x40 

0x41 

0x42 

0x43 

0x44 

0x45 

0x46 

0x47 

0x48 

0x49 

0x60 
0x61 
0x62 
0x63 
0x64 

0x70 
0x71 

0x80 
0x81 
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0x82 



frrguments 



Rpturn Value 



none 
none 
none 
none 
none 
none 

Integer, Integer 
Integer, Integer 
Integer, Integer 
String, String 
Boolean, Boolean 
String, String 
String, String 
Boolean, Boolean 
Boolean, Boolean 
Boolean 

Integer, Integer 
Integer, Integer 
Integer, Integer 
Integer, Integer 
Integer, Integer 

String, String 
String, Integer, Integer 



Integer 
String 
Boolean 
Integer 
String 
Boolean 

Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 
Boolean 

Integer 
Integer 
Integer 
Integer 
Integer 

String 
String 



Integer, Integer, Integer Integer 
Integer, Integer, Integer String 

Integer, Integer, Integer Boolean 
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Append* C 
Predefined Resources 



Navigation & System: 20 

Checkmark 
"X" 
■?" 

/ in a blue circle 
Close icon: down arrow. 
1 0 Back arrow: 1 80 degree loop 

Right Arrow: 12 styles 
Padlock 

Magnifying glass 

Polls: 4 

IS Thumbs up 

YES 

Thumbs down 
NO 

Payment/ Delivery/Ordering: 21 

20 Visa card 

Mastercard 

American Express card 
Optima Card 
Discover card 
25 FedEx Logo 

UPS Logo 
DHL logo 
USPS logo 

Airborne Express logo 
30 Dollar Sign 

Phone 
Fax machine 
Coins 
Money bills 
35 Price tag 

Brochure 
Pen & paper 
Envelope 
Stamp 

40 Grocery cart 

Entertainment: 10 

Television 
Admission ticket 
Musical notes 
45 . CD 

Audio Cassette 
Video Cassett 
film strip 

film camera/projector 
50 • Knife & fork 

Winebottl & glass 

N ws/Inf : 10 
Watch 
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Alarm dock 
Glob 

USA map 
Newspaper 
US flag 
Capitol dome 
stock grid 
car 

airplane 
van 
train 
bus 
Book 
Calendar 
Suitcase 
Beakers 

Nuclear energy symbol 

Weather/Almanac: 17 

Sun 
Cloud 

Sun w/cloud 
Cloud w/rain 
Rain drops 
Cloud w/snow 
Snowflake 
Lightning 
Tornado 
Hurricane 
Fog 

Full Moon 
Last Quarter 
New Moon 
First Quarter 

35 . Waves 

Thermometer 

Sports: 18 

Skier 

Soccer ball 
Baseball 

Official baseball logo 
Football 
NFL logo 
Basketball 
NBA logo 
Ice skates 
Hockey puck & stick 
50 • Bowling ball & bowling pins 

T nnis racquet 
Golf putter, golf ball, and t e 

Sailboat 
Boxing gloves 
55 . Horse 

Mis :7 
Key 
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LigntDuiD 
Graduation cap 
Construction hard hat 
Picture (photograph) 
Road work sign 
Rose 
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T im -Uve information system ft. — g and giving 

graphical interactive tofonnaUon system applications having a graphica. user interface 

COraPri ?p^vid.r component for broadcasting graphica. interactive information system 

output, for inserting the protoco! into a broadcast signal and presenting a, an output th. broadcast 

4 The system of claim 2 wherein the transmitter is a pager transmitter. 

' Z £Z of claim 2 wherein the transmitter is a ceUular telephone «nsmmer. 
fi The system of claim 2 wherein the transmitter is a televiston transmitter. 

5 rTe sU of claim 2 wherein me transmit is an out^W.—. 
9 Tnes y s K mofclaim2whereinmedaUin S e rt erisaVBId M a.ns«ter 

m .« for receiving the broadcast signal into which the protocol is mserted. 

7 of Calm ,0 wherein the transmit is a television transmit^ 

£ The sU» of claim 10 wherein the transmit*, is a cable telev,s,o» headed 

« amPlif ' 7* The svstem of claim 1 wherein the reception component comprises: 
information system plication from the desired frequency; 
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a microprocessor coupled to the data extractor output for controlling the operation of the 
reception component and interpreting interactive information system application commands and 
scripts; 

a graphics display generator having a first input coupled to the microprocessor for 
5 generating at an output a graphical user interface display signal; 

a display having an input coupled to the graphics display generator output, for displaying 
a graphical user interface from the graphical user interface display signal; and 

a storage device coupled to the microprocessor for storing interactive information system 
application information; 

10 14. The system of claim 13 wherein the graphics display generator has a second input 

coupled to the first tuner, and the graphics display generator is also for displaying a broadcast 
program. 

15. The system of claim 13 wherein the reception component additionally comprises a 
second tuner for receiving a broadcast signal and tuning a second desired frequency comprising a 

IS broadcast program at its output; and 

the graphics display generator has a second input coupled to the second tuner, and the 
graphics display generator is also for displaying a broadcast program 

16. The system of claim 13 wherein the reception component additionally comprises a 
user input receiver having an output, for receiving input from a user. 

20 17. The system of claim 16 wherein the user input receiver is a keypad. 

18. The system of claim 16 wherein the user input receiver is a infrared receiver. 

19. The system of claim 16 wherein the reception component additionally comprises a 
user input decoder having an input coupled to the user input receiver input and an output coupled 
to the microprocessor, for decoding input commands from a user. 

25 20. The system of claim 13 wherein the reception component additionally comprises an 

infrared emitter having an input for controlling an external device. 

21. The system of claim 20 wherein the reception component additionally comprises an 
infrared encoder having an input coupled to the microprocessor and an output coupled to the 
infrared encoder input for encoding microprocessor commands into infrared signals compatible 

30 with the external device. 

22. The system of claim 13 wherein the reception component additionally comprises a 
data line driver having an input coupled to the microprocessor and an output for allowing the 
microprocessor to communicate with an external device. W 

23. The system of claim 22 wherein the data line driver is a modem. 

35 24. The system of claim 22 wherein the data line driver is a DTMF tone dialer. 

25. The system of claim 22 wherein the data line driver is an addressable CATV set-top 
converter controller. 

26. The system of claim 13 wherein the the display comprises a television set. 

27. The system of claim 13 wherein the display comprises an LCD display. 
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28 The system of claim 13 wherein the first tuner is additionally coupled to the 
microprocessor for allowing the microprocessor to control the tuned frequency of the first tuner. 

29 The system of claim 13 wherein the first tuner is additionally coupled to the 
micropores for allowing the microprocessor to determine information relating to available 

frequencies in the first tuner. 

30 The system of claim 15 wherein the first tuner is additionally coupled to the 
microprocessor for allowing the microprocessor to control the tuned frequency of the first tuner. 

31 The system of claim 15 wherein the first tuner is additionally coupled to the 
microporcessor for allowing the microprocessor to determine information relating to available 

frequencies in the first tuner. 

32 The system of claim 13 wherein the broadcast signal comprises a broadcast program 
having a content related to a content of the interactive information system application. 

33. The system of claim 32 wherein the data extractor extracts the interactive 
information system application from the vertical blanking interval. 

34 The system of claim 13 wherein the broadcast signal comprises a broadcast 
advertisement having a content related to a content of the interactive information system 

application. . 

35. The system of claim 34 wherein the data extractor extracts the interactive 

information system application from the vertical blanking interval. 

36. The system of claim 15 wherein the interactive information system application 
comprises a content related to a content of the broadcast program. 

37. The system of claim 36 wherein the data extractor extracts the interactive 
information system application from an out-of-band frequency. 

38. The system of claim 36 wherein the data extractor extracts the interactive 
information system application from an FM frequency. 

39. A method of transmitting a graphical interactive information system application for 

display to, and control by, a user, comprising: 

describing a set of characteristics for at least one graphical object to produce at least one 

graphical object description; 
> broadcasting at least one of the graphical object descriptions; 

receiving at least one of the graphical object descriptions broadcast; and 
creating a graphical interactive information system display based upon at least one 

graphical object description received. 

40. The method of claim 39 wherein at least one graphical object description comprises 

5 form object definition record. 

41 . The method of claim 39 wherein at least one graphical object description comprises 

button object definition record. 

42. The method of claim 39 wherein at least one graphical object description comprises 

text object definition record. 
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43. The method of claim 39 wherein at least one graphical object description comprises a 
bitmap object definition record. 

44. The method of claim 39 wherein at least one graphical object description comprises a 
picture object definition record. 
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